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ABSTRACT 

A paradigm for the recalibration of teacher~made 
assessment that assesses and evaluates in one operation is 
formulated* The effort to make the classroom the primary source of 
educational research activity is contingent on redefining educational 
research as empirical and not experimental* This emphasizes that the 
empirical analysis of instruct ional effectiveness is a question of 
design effectiveness and calls for a new methodology for quantitative 
analysis, called edumetrics* Edumetrics consists of the formulation 
of a descriptive index coefficient, which can describe magnitude of 
student performance using teacher-made instruments as the numerical 
base* The Instructional Effectiveness Coefficient is discussed as an 
edumetric device that amalgamates the assessment and evaluation of 
instructional effectiveness and empirical educational research* Two 
edumetric algorithms are presented to assess and evaluate 
teacher-made tests* A new research epistemology is formulated that is 
quanti tatively intuitive and empirical* The formulated model is 
nonstochastic in its logic* (SLD) 
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Abstract 



A paradigm for the recalibration of teacher made assessment is formulated which 
assesses and evaluates in one operation. The Instructional Effectiveness Coefficient is 
discussed as an edumetric device which amalgamates the assessment and evaluation of 
instructional effectiveness and empirical educational research. A new research 
epistemology is formulated which is quantitatively intuitive and empirical. The model 
which is formulated is nonstochastic in its logic. 



Introduction 



The effort to make the classroom as the prime souice of educational research 
activity is contingent upon redefining educational research as empirical and not 
experimental. Generic research designs which employ true or quasi type of control or 
contrasting groups have given rise to complex multivariate designs which have yet to be 
proven decisive as yielding casual models which can lead to more effective classroom 
instruction (Draper 1995). 

By defining classroom research as empirical, we are emphasizing that the 
empirical analysis of instructional effectiveness is a question of design effectiveness and, 
therefore, can only be studied in the classroom at the time the instructional design is 
being executed and managed to its completion. 

Strategic Assumptions 

I. The basic question for classroom research is how effective is an instructional 
design? 

II. Since instructional effectiveness is the basic research question, parametric statistic 
and inference is not an appropriate paradigm for the analysis of student test or 
project performance. 

III. In light of assumptions I and II, a new methodology for quantitative analysis 
needs to be developed. This is called Edumetrics. 

IV. Edumetrics consist of the formulation of a descriptive index coefficient, which can 
describe magnitude of student performance using teacher made instruments as the 
numerical base. 
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V. Classroom research is empirical and not experimental. Experimentation involves 
a contrasting or control group. Since classroom research is non-stochastic, the 
researcher’s only interest is to determine how effectively an instructional design 
works. Empiricism requires an uncontrolled intervention which is instructional 
design. 

VI. The lEC is offered as an edumetric index coefficient, which can assess and 

evaluate instructional effectiveness in the same operation, thus eliminating the 
need for a control group. 

VII. The lEC can be employed with any edumetric method of tests or qualitative 
project calibration for the assessment of quality magnitudes. 

The following assumptions, which are strategic and modular, set our philosophic 
case for a new epistemology of data description which is empirically descriptive and 
edumetric. We shall depart from customary experimental design and challenge the basic 
assumption upon which traditional assumptions are made with regard to the 
experimental approach to classroom research. What we shall propose is heretical and 
intuitive. As with any new quantitative algorithm, this paper begins its foimulation on 
the frontier of a new discipline which we shall call.E dumetrics. a concept which has 
rarely, if ever, been considered as educations’ field of measurement as psychometrics is 
to psychology. 

For too many years traditional educational experimental research has been 
dominated by variants of the Campbell Stanley model of experimental design (Campbell 
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have speciously relegated teacher made efforts at assessment and evaluation of student 
performance to the level of routine drudgeiy. The use of traditional experimental design 
and inferential statistics has obscured the value of teacher made assessments in 
determining the effectiveness of an instructional design. In light of the aforementioned 
situation, we shall recommend the use of a newly developed edumetric algorithm, which 
will both assess and evaluate student performance either as a group or an individual 
function in such a manner as to assess and evaluate in one operation. The algorithm, as 
we shall describe it in the paper, will permit classroom research without a contrast or 
contrasting group through the use of a new descriptive statistic. 

Tactical Considerations 

We shall show how the lEC-G and the lEC-I can be used to recalibrate teacher 
made assessments so that instructional effectiveness can be inferred in either da 
summative or formative mode with either selected or constructed response instruments 
or with performance magnitudes of the summative attributes of qualitative projects. 

Many thousands of hours of teacher time are being wasted in assessment of 
teacher made tests and projects because their efforts are not being utilized as basic 
summative and formative indices of instructional effectiveness in experimental design. 
The classroom teacher research question is, "How effective is my instructional design in 
producing adequate svudent productivity?" 

Since the basic question of the classroom is one of instructional effectiveness, 
questions of statistical probalistic inference are not applicable. The classroom teacher is 
also not interested in establishing laws or generalizing to a population. The question of 
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also not interested in establishing laws or generalizing to a population. The question of 
instructional effectiveness is pragmatic and limited in its explanatory timeline. 

Therefore a new assessment procedure which is edumetric and descriptive js 
needed in order to transform teacher efforts to assess and evaluate student test and 
project performances. 

We shall, therefore, present two edumetric algorithms which assess and evaluate 
in one operation using teacher made extended and constructed response tests and project 
points. 

The algorithms are simple to calculate and interpret. 

The Instructional Effectiveness Coefficient 
For Groups and Individual Performance ^ 

(lEC-G and lEC-I) 

Steps in Calculation of the lEC-G : 

1. Class size: minimum of 15 students, maximum class size 

sample 

2. Calculate the average for a group of scores = 

3. Calculate the average of the scores below the mean = X, 

L 

4. Calculate the average score or mean X^ for scores above the 
group mean or X^. 

5. Subtract X^^ and X^j from the distribution mean and square 
each result or 

(X, - XJ2 = A 
and 

= B 

6 . Divide A and take the square root = V A = lEC-G 

B B 



or 



V 




lEC-G 




Interpretive Standards 

1.26 - 1.51 = Exceptional 

1.10 - 1.25 = Above the average 

.90 - 1.0 = Average 

.60 - .84 = Below the average 

Less than .60 = Deficient. Needs intervention for 
improvement . 

A preliminary validity study indicates that the lEC-G correlates 
.63 with a measure of negative skewness. The relationship 
suggests only minimum overlap between a measure skewness and 
lEC-G. 

Steps in Calculation of lEC-I; 

1 . Calculate the average group 

2. Divide each score by the distribution average or mean = 

3. Multiply each by lEC-G 
or [ (Xj) * (lEC-G) ] = lECI 

4. The student's score is a handwith of 



A. If score contains any value from 9.0 to 1.10 then the 
performance is average or acceptable. 

B. If score contains any value 1.11 to 1.25 then 
performance is above the average. 




* (lEC-G) 
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C. If score contains any value from 1.26 to 1.51, then 
performance is exceptional. 

D. If the score is between .75 and .89, performance is 
below the average. 

E. If score is less :'an .74, performance is defi:;ient. 

Reprise 

In this conceptual paper, we have explicated the logic and use of a new descriptive 
quantitative algorithm, which recalibrates the teacher made test and project, thereby 
permitting descriptive statements of group and individual performance without the use of 
a control or contrasting group. The key question which the lEC-G and lEC-I is 
designed to answer is the question of instructional effectiveness at the point the 
assessments are made. The summative instrument of a project or test can become 
formative in allowing for remedial or developmental intervention. The lEC-G and lEC-I 
free the teacher from the dominance of those specialists who view classroom research as 
a scientific enterprise which is encumbered by complex statistical analysis which 
denigrates the teacher made assessments. 

Implication Toward the Development in Edumetric Epistemology: 

The use of the lEC-G opens up research in instructional effectiveness, as well as 
forming a unique discipline of educational assessment called Edumetrics, a descriptive 
and intuitive recalibration of teacher made efforts to assess and evaluate aggregate and 
individual student performance. As a new technology of assessment, the lEC-G-I can be 
calculated with a simple bivariate statistical calculator, or it can be adapted for 
spreadsheet data description and analysis without the imposition of complex multivariate 
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statistical designs which are contingent for use upon the assumption of stochastic 
educational realities. The lEC-G appears to have its own domain of measurement and it 
may, upon deeper mathematic analysis, become the fifth statistical moment. 

The lEG can be used to analyze a semester of summative tests in the following 
manner; 

Each series of test scores is converted to a percentage * 10 score. This yields a 
score range from 1-9.9 across the entire series of teacher made tests for a semester. The 
lEC-G can be employed to analyze and evaluate the semester overall performance of a 
class and thereby providing the teacher a quality assurance index of student test 
performance and a part of a total class evaluation program. 

Other ratio types of indices can be developed which are non stochastic and 
descriptive of student performance. This we think should be the focus of Edumetrics as 
a discipline of education. As we see it now, Edumetrics bypasses traditional error 
mathematics in focusing on scaler and vector factors, which are implicit within the 
manner in which we have employed Euclidian distances as the gradient of the mean. 
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